Diffusion and entropy production for multi-networks with fitness factors 
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A diffusion process at a special class of multi-networks consisting of weakly coupled networks is 
analytically solved by an appropriate separation of time scales and by reducing the system dynamics 
to a Markov chain for aggregated variables. A presence of fitness factors describing attractiveness of 
individual nodes is taken into account. In the case of system of two coupled networks an equation 
analogous to the First Fick Law with an additional driving force and a corresponding diffusion 
constant are found. The entropy production is a sum of entropy changes resulting from a network 
heterogeneity and the entropy of the Markov chain. Our approach can be also used for hierarchical 
networks where several different time scales are present. 
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(to be modified...). Many systems can be described as 
structures of special units that are linked together in a 
form of networks. If these units are not compact objects 
but posses their internal network structure then one can 
use a framework of networks of networks or multiplex 
networks for description of their properties. Starting 
from Buldyrev et al. [lo| coupled complex networks are 
intensively investigated. There were considered their 
robustness 



[131, cascades of failures [IC 



lllj , problem 

of cooperation [sj and some percolation properties [isj . 
Authors of those papers were introducing the idea of 
networks of networks. The idea of networks of networks 
was successful because the real phenomenon (sociolog- 
ical or technical) seems to be more similar to a few 
independent networks connected with each other than 
to one huge network. This approach allows to account 
not only the global parameters but also the local impact 
between networks . The simplest example of networks of 
networks are two connected independent networks. This 
is also the most important case, because each network 
of networks consists of some pairs of networks. 



The diffusion processes are the objects of interest for 
researchers from different fields. They are important in 
the experimental and theoretical physics [2], as well as 
in the information theory f^. Recently, the diffusion on 
complex networks i^Jl was investigated using the theory 
of Markov chains [9| . 

Diffusion dynamics in a system of multiplex networks 
where nodes are conserved through the different layers of 
the multiplex have been considered very recently in the 
[ij. It has been shown that the Laplacian matrix of the 
multiplex network can be constructed from correspond- 
ing matrices of each layer. As result one can estimate the 
effective diffusion in the multiplex due to the layer-layer 
coupling. It was shown that a diffusion time scale in 
the multiplex is always shorter than a corresponding 
time scale calculated for the slower independent network 
due to he acceleration by the faster partner. The 



striking result is that for a strong interlayer coupling a 
superdiffusion effect can occur, i. e. the effective diffu- 
sion in multiplex is faster than in both separate networks. 

Here we consider a diffusion process on graph consist- 
ing of weakly connected complex networks. Each node 
of connected networks possesses its attractiveness, and 
particles choose a new node with a probability propor- 
tional to this parameter. There is no interaction between 
particles. Because of weak internetwork coupling one can 
separate a fast diffusion processes inside every network 
from a slower diffusion between different networks and 
find an approximated analytical solution for this prob- 
lem. Our system is different from the model considered 
in [H where a group of nodes was belonging to both net- 
works that made possible to develop an effective ana- 
lytical approach based on spectral properties of a corre- 
sponding adjacency matrix. 

Let N particles randomly diffuse on an undirected 
unweighed network A with an adjacency matrix A G 
^AfxM(|Q^ 1}) where every node i {i = 1, 2, . . . , Af) 
possesses its special fitness (attractiveness) fi > that 
defines its attraction strength for the moving particles. 
Evolution of particles density ni{t) at node i is given by 
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where gk = X)/ ^ikfi is a total attractiveness of node k 
neighbourhood. Let us stress that the fitness parame- 
ters defined by the vector f G are not the same as 
considered in [g^] where they determine an evolution of 
network topology that is time-independent in our case. 
The equilibrium density of particles follows from an er- 
godic distribution /Zi of a corresponding Markov chain 
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The Shannon entropy (per particle) of the equihbrium 
distribution can be calculated as 6*00 — X^fcli Mfelog/^fc- 
A short algebra leads to 



{ft9i l0g(/»ff»))a 



+ log(/,g,)av + logM, (3) 



where (•)av denotes averaging over all nodes of graph. 
The term logM at rhs of ^ describes the uniform dis- 
tribution of particles fXi — I /M that corresponds to the 
maximal entropy. It is easy to prove that 5*00 is always 
less than log M, which is a simple consequence of convex- 
ity of function f{x) — a; log a; and Jensen's inequality 3]. 
The non-positive valued sum of the first two terms at the 
rhs ([3]) Soo = 5*00 — log M describes the lowering of the 
equilibrium particle entropy induced by the complexity 
of network topology. It equals to zero when every node 
posses the same fitness factors fi = f and the network is 
a regular graph, where ki = kav 

Let the network A can be represented as a pair of two 
weakly connected (sub-)networks A^^^ and yl^^^ (see Fig. 
[T] (a)) of sizes M^-^'' and M^^^ respectively (further we 
shall consider a larger number of sub- networks) . Inter- 
nal connections between nodes belonging to the same net- 
work a are described by the adjacency matrices G 
M*^*°'x*^'"'({0, 1}), while the matrix C e M^^*"x*-f*" 
corresponds to interlinks connecting both networks. The 
global adjacency matrix is 



Itotal 



C 



(4) 



We assume only weak coupling between both networks 
and C is a sparse random matrix with a parameter 
Pc ^ ^ describing a probability that a pair of nodes be- 
longing to two different networks A^^^ and A'^'^^ is di- 
rectly connected. The global vector of attractiveness 

s -r ( 1 ) I s 7" ( 2 ) 

f G R_|_ consists of corresponding vector com- 

ponents f G M:![_^'°' describing attractiveness of nodes 
in separated networks. The vector of neighbourhood 
g G should be calculated by taking into ac- 

count also interlinks introduced by the matrix C however 
because of weak internetwork coupling its components 
can be approximated by neighbourhood attractiveness of 



1, 2. 



separated networks g^"^ G 

Let us assume that a flow between a node i belonging to 
a network A^"^^ to all nodes in this network is much larger 
than a flow from this node to nodes in the network A^^^ 
where a,h = 1,2 and a ^ h. Such a situation takes place 
when an attractiveness of a node neighbourhood in the 
network a is much larger than an attractiveness coming 
from nodes belonging to the network h and connected to 
this node 



(5) 



The condition above is fulfilled since we have assumed 
Pc ^ 1- When flows inside the networks are much larger 





(b) 




A/<^'(t) 



FIG. 1. Connected complex networks. Figure (a) presents 
two connected Barabasi- Albert networks (each consists of 60 
nodes). Figure (b) illustrates separating time scales approxi- 
mation, which can be described as looking at two connected 
networks as one two-state graph. Diffusion in every graph is 
faster than diffusion between graphs. 



than between them then characteristic time scales for 
internal processes are much shorter than for processes 
taking place between the networks. There is not only 
physical reason for the separation of time scales under 
the assumption ([5|). According to the paper of Lawler 
and Sokal [23| about Cheeger inequality for the Markov 
Chains the second eigenvalue of the Markov operator is 
bounded by the constant which is connected to the slow- 
est transition from one subset of graph to its complement. 
In our case, assumptions ^ provide boundary to the 
time of reach the equilibrium on the system. Because of 
the weak connection equilibrium on every networks will 
be reached faster than equilibrium between them, which 
implies separation of time scales. 

Suppose that fitness of every node is constant and equal 
to / > and there are no degree-degree correlations in 
any network. An average attractiveness of the neighbour- 
hood in a network a is then equal to (5^"'')av = fkiv\ 
a = 1,2. The relations © leads to to kt^ > M^^^pc 



a, b — 1, 2, a ^ b. It means an average inter-network 
degree for a must be smaller than an internal degree. 
It is interesting to compare a validity of the mentioned 
assumption in cases when connected networks are two 
Erdos-Renyi graphs and when they are two Barabasi- 
Albert networks. Let assume that in the first case graphs 
posses equal number of nodes and are described by pa- 
rameters p^^'^ and corresponding to probabilities that 
two randomly chosen nodes are directly connected in a 
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given graph. Then we get p^^^ , p^'^^ ^ pc and clearly these 
conditions do not depend on size of networks so for every 
size of networks we can use the same Pc- This relation 
was received when we considered an average degree in 
Erdos-Renyi graph what is justified since a dispersion of 
the degree distribution is negligible. In Barabasi-Albert 
networks case (described with parameters m^^"^ and to*^^) 
respectively) the situation is different since a degree dis- 
tribution is a power law. Taking a necessary condition for 
the minimal node degree we receive m^^\m^^^ ^ Mpc- 
In that case an appropriate value of Pc is related to net- 
work sizes. 

Let n[''\t) where i = 1, 2, . . . , Af(°), a = 1, 2, de- 
scribes the number of particles in the i-th node of the 
a-th network. We assume 



(6) 



where A^(") (t) are the total number of particles in the a-th 
network at time t and /x^"^ are equilibrium distributions 
of density of particles in the non-connected networks. 
These distributions are defined by Eq. ([2]). The sum of 
numbers of all particles is preserved N^^\t) + N^^\t) — 
N — const. 

Using the above approximation we get from Eq. ([T]) 
iV(i)(t + 1) = (1 - a(2i))Ar(i)(t) + a(i2)iv(2)(t), (7) 

where a^"''-' are constants dependent on A^^\ A'-'^\ pc, 
f(i), f(2) as follows 



-Pc 



r{a) p{b} 
Jav Jav 



(8) 



where a, 6 = 1, 2 and a ^ b and a corresponding equa- 
tion for A^(^^(i -|- 1) follows directly from Eq. [7] by ap- 
propriate symmetry relations. The parameters a^^ ^-^ and 
a'^ describe integrated transition probabilities between 
the networks at the macroscopic level (see Fig. [T]) and 
can be further simplified when there is no correlation be- 
tween a node degree and a node fitness factor f '^"^ e.g. 

(//'^^5l'^^)av = /ie^5i?^ Then 



(a) ,(a) 



(9) 



where a, b — 1, 2, a ^ b and a^^^\ a^^ <C 1 from Eq. 
©■ 

Using initial conditions A^(^)(0) 
iV(2)(o) = (1/2 - e) one gets [j 



{l/2 + e)N and 



iV(i)(t) ^CiN + C'^{l/2 + e-Ci)N. 



(10) 



whereCi =a(2i)/(a(i2)+a(2i)) and C2 = l-a^^^) „ 
a(2i). 

It follows there is an equilibrium number of particles 




FIG. 2. Influence of internal network density on a difi'usion 
constant for two weakly connected complex networks. The red 
line (analytical solution) and circles (numerical simulations) 
correspond to a pair of Barabasi-Albert networks. Each of 
them consists of AI = 500 nodes, the mean internal degree of 
the A'-^^ network is constant and equal to fcii' = 20 while the 
corresponding parameter fciv' of the A^'^^ network is changing 
(see the bottom frame). Probability of internetwork connec- 
tions Pc = 4 • 10"^. The green line (analytical solution) and 
squares (numerical simulations) correspond to a pair of Erdos- 
Renyi graphs. Each of them consists of M = 200 nodes, the 
mean internal degree fci^ of the A'^^■' network is constant and 
it equals to Mp^^'' — 20 where p'^' = 0.1 is a probability for 
an intra-network link existence between two randomly chosen 
nodes in the network. A corresponding parameter p2 of the 
A^'^^ network (hence its intra-network density fciv' — Mp'-^^) 
is changing (see the top frame). Probability of internetwork 
connections pc = 3.75 • 10~^. The inset shows an example 
of numerical evolution of total numbers of particles in both 
networks used for fltting and q'^' and q'^' characteristic pa- 
rameters (see text). In each case dynamics is non-preferential. 



-f(i) 



(2) 



const, ia 
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the equilibrium state variations of N^^^^ (t) are sufficiently 
slow and then it is possible to write Eq. ([7]) in a form 
analogous of the First Ficks's Law [2l[ with a diffusion 
constant D and in the presence of an additional internet- 
work driving force F 

N^^\t) = - (iV(i)(i) - iV(2)(t)^ D + FN, (11) 



where 



D = 



y(12) 



y(2 1) 



F 



v(2 1) 



v(12) 



(12) 



inthe^^^-' network A^io = a^'^^^N/{a^^'^^ +a^'^^''). Near degrees fciv because of the neighbourhood attractiveness 



Let us note that the driving force F can cause a non- 
zero flux M^\t) even if there is no gr adient N'^^^t) - 
N'-^'>{t). The force F results from differences in the net- 
work sizes M^"), from differences in the network mean 
fitness f and from the differences in the mean network 

(a) 
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g(°)j a = 1, 2. The last dependence can be interpreted as 
a topological influence on the diffusion process, e.g. both 
networks can be attributed some potentials dependent 
on their topology. It follows changes in networks internal 
topology can induce a particle flux between the networks, 
e.g. adding a new link between two nodes in the A^^'^ net- 
work increases its mean degree k'^ thus the parameter 
a^^ decreases and more particles are transported to this 
network. The denser is the network the larger number 
of particles will it attract in the equilibrium state. 
It is interesting from the applicational point of view - 
by changing structures of the networks or their connec- 
tions one can modify not only diffusion constants but also 
change a direction of particles flow. 
The above calculations show a connection between 
macroscopic quantities, i.e. the diffusion constant D or 
the driving force F and internal or internetwork topo- 
logical properties. Fig. [2] presents an influence of in- 
ternal networks link density on a diffusion constant for 
two connected Barabasi- Albert networks and two con- 
nected Erdos- Renyi graphs. Analytical calculations fol- 
lowing from Eqs. ([8|), ([T2l) well correspond to numerical 
results obtained from random walks simulation. Param- 
eters a*-^ and and the resulting diffusion constant 
D were received from the best fit Eq. ([TU]) to numerically 
received dependences N^^\t) and iV*^^-'(t) - see the figure 
inset. As we can see on graph - the diffusion constant 
D is decreasing with increasing an internal density of a 
network. It is understandable - when a network becom- 
ing denser, its easier keeps particles in its interior since a 
diffusing particle more frequently selects an internal links 
as compared to external ones. It is reflected by decrease 
of parameters a^^^^ and a^^ and hence the diffusion 
constant D as functions of internal degrees fciv\ see Eqs. 
1 

Using the approximation of separation of the time scales 
Q the total entropy of the system can now be written 
as 



7V(i' (t) log 7V(i) (t) - iV(2) (t) log iV(2) (<) + N log n] , 

(13) 



time derivative of the Stotai given by ([13)) 
a{t) = 7V(i) it) (log iV(2) (i) _ log ^(1) (i) + 5(1) _ ^(2 



where a = 1, 2 are the equilibrium entropy per 

particle in each network (see Eq. ([3])). It follows changes 
of system entropy come from entropy at the macroscopic 
level (two-state Markov chain, see Fig. [IJ and transport 
of microscopical entropies related to network topologies 
S'^\ for a = 1, 2 that can be different in both networks. 

Up to now we have considered the model of two coupled 
networks. It is easy to show that our approach is valid 
also for any system of m weakly coupled networks i.e. 
for networks of networks or for multiply networks. Then 
instead of equation ([7]) one gets 



(14) 



7V(°)(t + l) = ^a(°')7V(''(^), 



(15) 



1=1 



where a^"^^ describes a strength of flow from a network 
j[ib) to for a^b. 



„(a) Jb) 



Then equation (fTTI) changes to 



(16) 



iv(")(t) = ^[-i:i('")(iv(")(i) -iv(')(i))+ (17) 

+i;^0a)(7V(«)(t) +iv(')(t))], (18) 



where 

~ 2 ' ^ 2 ■ 

(19) 

The equilibrium distribution of A^^"' follows from a fixed 
point of the linear operator at the rhs (|15p and its sec- 
ond eigenvalue describes the rate this equilibrium is ap- 
proached. For the case of multiply networks the produc- 
tion of entropy (|14p is 



a(t)=^AW[5W-logA^M(t)]. 



(20) 



where S, 



[a) 



1, 2, are equilibrium entropies per par- 



ticle given by Eq. ([3]) for the A'^^^ and the A^-^^ network. 
The first square bracket in (|13p results from lack of infor- 
mation about particle position inside the given network. 
The second bracket in ([T3|) is the entropy of the two-state 
Markov chain (see Fig. [1] (b)) and results from a lack of 
information about a particles sharing between both net- 
works. 

Now the entropy changes can be written by taking the 



The approach is valid also if one considers diffusion on 
weighted networks with self-loops. Then the symmetrical 
adjacency matrix A in Eq. ([1]) is defined by non-negative 
elements including diagonal elements. Looking at 
one finds that it possesses the structure of ^ when pa- 
rameters fa, Qa and Aab, a, b — 1, . . . , m, for higher level 
{X means parameter X for the higher level) are appro- 
priately defined, e.g. 



(21) 
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It follows one can consider iterations of our approach for a 
next level when groups of networks are weakly connected 
to the group of networks. Thus one is in possession to 
consider a system of hierarchically build weakly-coupled 
networks. 

Conclusions (to be extended...). 
In this paper we have considered diffusion processes on 
weakly connected complex networks with a special fit- 
ness parameters of individual nodes. We have introduced 
an analytical approach that bases on separation of time 
scales describing dynamics at different levels. The ap- 
proximation makes possible an analytical estimation of 
equilibrium distribution of diffusing particles and a pro- 
duction of entropy in multinetworks as well as in hierar- 
chical systems of weakly coupled networks. 
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